Add Anthropic Compatible provider support #7654

Dayleyfocus · 2025-09-04T04:02:14Z

Introduces a new 'anthropic-compatible' provider with schema, API handler, and UI components for custom Anthropic-compatible endpoints. Updates provider selection, model handling, and settings to support custom base URLs, auth tokens, and model configuration.

Related GitHub Issue

Closes: #

Roo Code Task Context (Optional)

Description

Test Procedure

Pre-Submission Checklist

Issue Linked: This PR is linked to an approved GitHub Issue (see "Related GitHub Issue" above).
Scope: My changes are focused on the linked issue (one major feature/fix per PR).
Self-Review: I have performed a thorough self-review of my code.
Testing: New and/or updated tests have been added to cover my changes (if applicable).
Documentation Impact: I have considered if my changes require documentation updates (see "Documentation Updates" section below).
Contribution Guidelines: I have read and agree to the Contributor Guidelines.

Screenshots / Videos

Documentation Updates

Additional Notes

Get in Touch

Important

Adds anthropic-compatible provider with schema, API handler, and UI components for custom Anthropic-compatible endpoints.

Behavior:
- Adds anthropic-compatible provider to provider-settings.ts and providers/anthropic.ts.
- Implements AnthropicCompatibleHandler in anthropic-compatible.ts for handling API requests with custom base URLs and auth tokens.
- Updates buildApiHandler() in index.ts to support anthropic-compatible.
UI Components:
- Adds AnthropicCompatible component in AnthropicCompatible.tsx for UI settings.
- Updates ApiOptions.tsx to include anthropic-compatible in provider selection.
- Updates constants.ts and providers/index.ts to register anthropic-compatible.
Misc:
- Updates useSelectedModel.ts to handle model selection for anthropic-compatible.
- Adds translations for anthropic-compatible in settings.json.

^{This description was created by}^{for 4173863. You can customize this summary. It will automatically update as commits are pushed.}

Introduces a new 'anthropic-compatible' provider with schema, API handler, and UI components for custom Anthropic-compatible endpoints. Updates provider selection, model handling, and settings to support custom base URLs, auth tokens, and model configuration.

webview-ui/src/components/settings/providers/AnthropicCompatible.tsx

ellipsis-dev · 2025-09-04T04:04:29Z

webview-ui/src/components/settings/providers/AnthropicCompatible.tsx

+				<Button
+					variant="secondary"
+					onClick={() => setApiConfigurationField("anthropicCustomModelInfo", openAiModelInfoSaneDefaults)}>
+					Reset to Defaults


Replace the hardcoded 'Reset to Defaults' button text with a translation key to support internationalization.

Suggested change

Reset to Defaults

t("settings:providers.resetToDefaults")

^{This comment was generated because it violated a code review rule: irule_C0ez7Rji6ANcGkkX.}

roomote

Thank you for your contribution! I've reviewed the changes and found several issues that need attention before this can be merged.

Critical Issues

Missing GitHub Issue Link - The PR template requires linking to an approved GitHub issue, but the "Closes: #" field is empty. This violates the contribution guidelines.
Incomplete PR Template - Several required sections are not filled out (Description, Test Procedure, Pre-Submission Checklist, etc.)
Missing Tests - No test files found for the new AnthropicCompatibleHandler class or UI component. This significant feature needs test coverage.
Custom Model Info Not Used - The handler doesn't use the custom model info that users configure in the UI (line 244 in anthropic-compatible.ts).

roomote · 2025-09-04T04:07:22Z

src/api/providers/anthropic-compatible.ts

+import type { SingleCompletionHandler, ApiHandlerCreateMessageMetadata } from "../index"
+import { calculateApiCostAnthropic } from "../../shared/cost"
+
+export class AnthropicCompatibleHandler extends BaseProvider implements SingleCompletionHandler {


This handler appears to be nearly identical to the AnthropicHandler (99% duplicate code). Could we refactor this to extend AnthropicHandler and only override the getModel() method to handle custom model info?

roomote · 2025-09-04T04:07:22Z

src/api/providers/anthropic-compatible.ts

+	getModel() {
+		const modelId = this.options.apiModelId
+		let id = modelId && modelId in anthropicModels ? (modelId as AnthropicModelId) : anthropicDefaultModelId
+		let info: ModelInfo = anthropicModels[id]


The custom model info (anthropicCustomModelInfo) that users can configure in the UI is not being used here. The handler always falls back to predefined anthropicModels instead of using the custom settings. Should this use: this.options.anthropicCustomModelInfo || anthropicModels[id]?

roomote · 2025-09-04T04:07:22Z

webview-ui/src/components/settings/providers/AnthropicCompatible.tsx

+
+			<div className="flex flex-col gap-3">
+				<div className="text-sm text-vscode-descriptionForeground whitespace-pre-line">
+					Custom Model Configuration


These UI labels should use the translation system for internationalization. Consider using t('settings:providers.customModelConfiguration') instead of hardcoded English text.

roomote · 2025-09-04T04:07:23Z

webview-ui/src/components/settings/providers/AnthropicCompatible.tsx

+				onInput={handleInputChange("apiModelId")}
+				placeholder="claude-3-5-sonnet-20241022"
+				className="w-full">
+				<label className="block font-medium mb-1">Model Name</label>


Missing i18n: Should use translation key instead of hardcoded "Model Name"

roomote · 2025-09-04T04:07:23Z

webview-ui/src/components/settings/providers/AnthropicCompatible.tsx

+						})}
+						placeholder="200000"
+						className="w-full">
+						<label className="block font-medium mb-1">Context Window Size</label>


Missing i18n: Should use translation key instead of hardcoded "Context Window Size"

roomote · 2025-09-04T04:07:23Z

webview-ui/src/components/settings/providers/AnthropicCompatible.tsx

+						})}
+						placeholder="8192"
+						className="w-full">
+						<label className="block font-medium mb-1">Max Output Tokens</label>


Missing i18n: Should use translation key instead of hardcoded "Max Output Tokens"

roomote · 2025-09-04T04:07:23Z

webview-ui/src/components/settings/ApiOptions.tsx

 			)}

-			{selectedProviderModels.length > 0 && (
+			{selectedProviderModels.length > 0 && selectedProvider !== "anthropic-compatible" && (


Is hiding the model dropdown intentional for anthropic-compatible? Users might want to select from known models before customizing. Consider showing the dropdown but making it optional, or adding a comment explaining why it's hidden.

The model dropdown is intentionally hidden for anthropic-compatible since it's meant to be a generic provider where users type custom model names.

…le.tsx Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

hannesrudolph · 2025-09-04T05:10:10Z

@daniel-lxs talk to me about this plz

daniel-lxs

Thank you for this contribution! I've left some inline comments for your consideration.

daniel-lxs · 2025-09-08T21:24:14Z

src/api/providers/anthropic-compatible.ts

+	getModel() {
+		const modelId = this.options.apiModelId
+		let id = modelId && modelId in anthropicModels ? (modelId as AnthropicModelId) : anthropicDefaultModelId
+		let info: ModelInfo = anthropicModels[id]


I noticed the custom model info from the UI isn't being used here. Was this intentional, or should it be checking for custom settings first?

Suggested change

let info: ModelInfo = anthropicModels[id]

let info: ModelInfo = this.options.anthropicCustomModelInfo || anthropicModels[id]

This would allow the custom context window and capabilities configured in the UI to take effect.

daniel-lxs · 2025-09-08T21:24:14Z

webview-ui/src/components/settings/ApiOptions.tsx

 			)}

-			{selectedProviderModels.length > 0 && (
+			{selectedProviderModels.length > 0 && selectedProvider !== "anthropic-compatible" && (


Have you considered adding model fetching from the custom endpoint? It could make the experience smoother by letting users select from a dropdown instead of typing model IDs. Something like:

else if (selectedProvider === "anthropic-compatible" && apiConfiguration?.anthropicBaseUrl) { vscode.postMessage({ type: "requestAnthropicCompatibleModels", values: { baseUrl: apiConfiguration.anthropicBaseUrl, apiKey: apiConfiguration.apiKey } }) }

Though I understand if the manual entry is by design for flexibility with different endpoints.

hannesrudolph · 2025-09-23T03:57:05Z

Stale, please make new PR of still interested.

Dayleyfocus requested review from cte, jr and mrubens as code owners September 4, 2025 04:02

github-project-automation bot added this to Roo Code Roadmap and Roo Code Roadmap Sep 4, 2025

github-project-automation bot moved this to New in Roo Code Roadmap Sep 4, 2025

github-project-automation bot moved this to Triage in Roo Code Roadmap Sep 4, 2025

dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. enhancement New feature or request labels Sep 4, 2025

ellipsis-dev bot reviewed Sep 4, 2025

View reviewed changes

roomote bot reviewed Sep 4, 2025

View reviewed changes

hannesrudolph added the Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. label Sep 4, 2025

Update webview-ui/src/components/settings/providers/AnthropicCompatib…

b6df473

…le.tsx Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

daniel-lxs moved this from Triage to PR [Needs Prelim Review] in Roo Code Roadmap Sep 4, 2025

hannesrudolph added PR - Needs Preliminary Review and removed Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. labels Sep 4, 2025

daniel-lxs reviewed Sep 8, 2025

View reviewed changes

daniel-lxs moved this from PR [Needs Prelim Review] to PR [Changes Requested] in Roo Code Roadmap Sep 8, 2025

hannesrudolph added PR - Changes Requested and removed PR - Needs Preliminary Review labels Sep 8, 2025

hannesrudolph closed this Sep 23, 2025

github-project-automation bot moved this from New to Done in Roo Code Roadmap Sep 23, 2025

github-project-automation bot moved this from PR [Changes Requested] to Done in Roo Code Roadmap Sep 23, 2025

	let info: ModelInfo = anthropicModels[id]
	let info: ModelInfo = this.options.anthropicCustomModelInfo \|\| anthropicModels[id]

Add Anthropic Compatible provider support #7654

Add Anthropic Compatible provider support #7654

Uh oh!

Conversation

Dayleyfocus commented Sep 4, 2025 • edited by ellipsis-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Related GitHub Issue

Roo Code Task Context (Optional)

Description

Test Procedure

Pre-Submission Checklist

Screenshots / Videos

Documentation Updates

Additional Notes

Get in Touch

Uh oh!

Uh oh!

ellipsis-dev bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot left a comment

Choose a reason for hiding this comment

Critical Issues

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

Dayleyfocus Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

hannesrudolph commented Sep 4, 2025

Uh oh!

daniel-lxs left a comment

Choose a reason for hiding this comment

Uh oh!

daniel-lxs Sep 8, 2025

Choose a reason for hiding this comment

Uh oh!

daniel-lxs Sep 8, 2025

Choose a reason for hiding this comment

Uh oh!

hannesrudolph commented Sep 23, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Dayleyfocus commented Sep 4, 2025 •

edited by ellipsis-dev bot

Loading